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SUMMARY 


This  report  describes  several  applications  of  decision 
analysis  to  the  Army's  Affordability  Study.  These  applica¬ 
tions  are  focused  on  the  allocation  of  resources  to  support 
the  requirements,  concepts,  and  plans  of  the  Army.  The 
purpose  of  these  applications  is  to  establish  a  rigorous 
methodology  to  assist  the  decision  makers  in  allocating 
resources . 

Decision  analysis  is  a  quantitative  procedure  for  the 
systematic  evaluation  of  the  alternatives  available  to  a 
decision  maker.  The  process  defined  as  decision  analysis  is 
to  decompose  a  decision  problem  into  clearly  defined  compo¬ 
nents,  so  that  all  options,  outcomes,  values,  and  probabili¬ 
ties  are  depicted.  The  explicit  representation  of  the 
decision  not  only  provides  a  recommended  course  of  action, 
but  also  facilitates  communication  among  those  involved. 

So,  it  should  be  emphasized  that  decision  analysis  does  not 
replace  decision  makers  but  structures  the  role  of  wise 
human  judgment  in  the  decision  processj^ 

The  first  application  of  decision  analysis  is  the  use 
of  cost-benefit  analysis  to  prioritize  the  Army  program  and 
budget  decision  units.  This  process  involves  quantifying 
the  relative  benefits  and  costs  of  each  decision  unit. 

Since  the  purpose  of  the  prioritization  is  to  determine  the 
allocation  of  money  to  a  discrete  number  of  decision  units, 
the  quantification  of  benefit  is  done  according  to  an  Army 
mission  value  system,  not  according  to  a  monetary  value 
system. 

The  ’■enefits  are  judgmental  assessments,  obtained  by 
first  quantifying  the  relative  benefits  of  programs  within 
the  areas  of  each  sponsor  (e.g.,  operations,  personnel)  and 


} 

then  determining  the  relative  benefits  of  selected  programs 
from  each  sponsor's  list.  Once  the  benefits  have  been 
quantified,  the  decision  units  can  be  prioritized  from  the 
most  cost-beneficial  (benefit  per  dollar)  to  least  cost- 
beneficial.  This  procedure  has  been  applied  to  the  priori¬ 
tization  of  334  Program  Analysis  Resource  Review  (PARR) 
issues  and  185  Program  Development  Incremental  PacJcages 
(PDIP)  in  the  POM  80-84  development.  The  same  process  will 
be  used  in  the  budget  preparation  during  August  and  September. 
In  both  cases  so  far,  the  decision-analytic  process  provided 
a  very  useful  starting  point  from  which  issues  could  be 
determined  and  discussed  by  the  decision  ma)cers. 

Multi-attribute  utility  analysis  is  the  second  decision 
analytic  technique  that  will  be  investigated  during  this 
affordability  study.  A  multi-attribute  utility  model  is 
hierarchical  in  nature,  as  the  top-level  factor  in  the 
analysis  is  successively  divided  until  highly  specific 
characteristics  or  parameters  are  detailed  at  the  bottom  of 
the  hierarchy.  This  process  will  be  used  in  mission  capa¬ 
bilities  analyses  that  are  directed  primarily  at  ASARC 
reviews  and  major  issues  defense. 
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1.0  INTRODUCTION 


The  purpose  of  this  report  is  to  describe  several 
applications  of  decision  analysis  to  the  U.S.  Amy's  Afford¬ 
ability  Study,  which  is  being  undertaken  by  the  Program 
Analysis  and  Evaluation  Directorate  (PAE) ,  Office  Chief  of 
Staff  Army.  This  Affordability  Study  has  been  prompted  by 
the  recognition  that  in  the  current  technological  explosion 
opportunities  exceed  resources  to  exploit.  The  central 
question  is:  How  do  we  modernize,  maintain  readiness, 
enhance  sustainability,  develop  human  commitment,  .  .  . ,  to 
meet  the  threat  of  the  1990' s,  given  3%  real  growth?  That 
is,  the  U.S.  Army  must  maintain  and  program  the  most  effec¬ 
tive  fighting  force  for  the  future  within  very  clear-cut 
budgetary  constraints.  To  do  this,  the  relative  merits  of 
all  Army  programs  must  be  compared.  The  Army  has  begun  to 
develop  the  tools  and  disciplines  needed  to  answer  questions 
about  the  marginal  mission  benefit  of  individual  programs  in 
order  to  develop  a  means  of  prioritizing  competing  issues. 

The  Army's  Affordability  Review  Program  attempts  to 
offer  decision  makers  a  rational  means  of  responding  to 
these  new  management  challenges.  The  Army  uses  the  term 
"affordability"  to  describe  efforts  within  the  Army  Staff  to 
develop  and  apply  the  tools  and  disciplines  required  to 
measure  and  then  to  evaluate  marginal  costs  and  mission 
benefit.  The  efforts  stem  from  the  realization  that  an 
initiative  may  be  cost-effective  yet  not  affordable.  An 
affordability  analysis,  then,  is  an  investigation  of  the 
effects  of  constrained  resources  on  alternative  Army  programs 
The  objective  of  such  analysis  is  to  maximize  combat  capa¬ 
bilities  within  a  projected  level  of  resource  constraints. 
Until  now,  affordability  decisions  were  made  almost  intui¬ 
tively,  given  the  absence  of  a  systematic  and  disciplined 
effort  to  assess  the  full  impact  of  a  program  on  the  planning 


programming,  and  budgetary  continuum.  The  applications  of 
decision  analysis  described  in  this  report  are  part  of  these 
affordability  analyses. 

The  primary  problem  addressed  by  these  decision-analytic 
applications  is  the  current  lack  of  a  defined  basis  (method¬ 
ology  with  analytic  rigor)  to  assist  decision  makers  in 
determining  the  proper  allocation  of  constrained  dollar 
resources  among  competing  Army  programs  in  support  of  the 
Army's  requirements,  concepts,  and  plans.  Therefore,  the 
purpose  here  is  to  provide  the  Army  an  explicit  and  documented 
basis  for  allocating  constrained  resources  among  competing 
requirements,  concepts,  and  plans.  To  accomplish  this, 
there  are  three  objectives: 

1.  Determine  whether  decision  analysis  can  be  applied 
in  a  rigorous  way  in  the  Army's  existing  resource 
allocating  process. 

2.  Develop  an  Army  procedure  for  prioritizing  decision 
units  across  appropriations. 

3.  Evaluate  the  utility  of  the  technique  for  priori¬ 
tizing  the  allocation  of  resources  among  alterna¬ 
tive  requirements,  plans,  concepts,  strategies, 
and  programs  given  fiscal,  manpower,  and  time 
resource  constraints. 

In  order  to  be  successful,  any  prioritization  procedure 
must  include: 

o  uniform  rationale  for  identifying  program  packages; 

o  values  based  on  the  mission  goals; 

o  functional  (multi-appropriation)  program  packages; 

o  a  funding  strategy  for  various  fiscal  constraints; 
and 
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o 


documentation  of  the  process. 


The  rationale  for  defining  program  packages  to  be  con¬ 
sidered  for  funding  should  be  open  and  common  to  all  propo¬ 
nents.  The  relative  values  for  these  packages  should  be 
based  on  the  Army  goals,  with  other  factors  to  be  considered 
as  a  deviation  from  the  prioritization.  The  proponents,  and 
therefore  the  program  packages,  should  be  based  on  functional, 
not  appropriation,  categories.  The  prioritization  process 
should  result  in  a  funding  strategy  for  a  number  of  fiscal 
constraints  that  might  be  imposed  by  the  Office  of  the 
Secretary  of  Defense  (OSD) .  Finally,  the  process  should  be 
documented  and  reproducible. 

Section  2.0  of  this  report  describes  decision  analysis 
and  the  methodologies  used  in  these  applications.  The  first 
methodology  addresses  the  prioritization  of  decision  units 
directly  by  quantifying  their  relative  benefits  and  by  using 
the  cost-benefit  criterion  to  prioritize.  Multi-attribute 
utility  theory  is  the  second  methodology  that  can  be  used  to 
analyze  the  relative  capabilities  of  the  Army  within  missions. 
This  is  an  indirect  link  to  the  prioritization  problem 
because  it  will  provide  a  framework  that  will  be  very  useful 
in  the  quantification  of  the  relative  benefits  for  the 
decision  units  in  the  first  application. 

Section  3.0  discusses  the  application  of  the  first 
methodology  to  the  prioritization  of  the  Program  Analysis 
Resource  Review  (PARR) ,  the  1980  Program  Objective  Memorandum 
(POM-80)  decision  units,  and  the  decision  units  of  the  1980 
budget.  Section  4.0  will  document  (when  published)  the 
application  of  multi-attribute  utility  theory  to  the  analysis 
of  Army's  mission  capabilities.  Section  5.0  contains  a 
brief  discussion  of  topics  related  to  these  two  applications. 
Finally,  the  conclusions  and  recommendations  are  presented 
in  Section  6.0. 


2.0  METHODOLOGY — DECISION  ANALYSIS 


Decision  analysis  is  a  quantitative  method  for  the 
systematic  evaluation  of  the  costs  or  benefits  accruing  to 
courses  of  action  that  might  be  taken  in  a  decision  problem. 

It  entails  identification  of  the  alternative  choices  involved, 
the  assignment  of  values  (costs/benefits)  for  possible  out¬ 
comes,  and  the  expression  of  the  probability  of  those  outcomes 
being  realized.  With  this  information  at  hand,  one  can  then 
systematically  combine  the  values  and  probabilities  to  show 
the  probable  gain  or  loss  that  is  associated  with  each 
alternative  choice.  Since  1970,  there  has  been  a  dramatic 
burgeoning  of  efforts  by  defense  agencies  to  adapt  this 
technology  to  their  day-to-day  decision  making.  Many  have 
found  it  a  way  to  make  better,  more  defensible  decisions. 

In  the  application  of  decision  analysis,  a  problem  is 
decomposed  into  clearly  defined  components  in  which  all 
options,  outcomes,  values,  and  probabilities  are  depicted. 
Quantification  in  the  form  of  the  value  for  each  possible 
outcome  and  the  probability  of  those  values  (or  costs)  being 
realized  can  be  in  terms  of  objective  information  or  in  the 
form  of  quantitative  expressions  of  the  subjective  judgments 
of  experts.  In  the  latter  case,  the  quantitative  expression 
serves  to  make  explicit  those  subjective  qualities  which 
would  otherwise  be  weighted  in  the  decision  process,  albeit 
in  a  more  elusive,  intuitive  way. 

Beyond  its  primary  role  of  serving  as  a  method  for  the 
logical  solution  of  complex  decision  problems,  decision 
analysis  has  additional  advantages  as  well.  The  formal 
structure  of  decision  analysis  makes  clear  all  the  elements, 
their  relationships,  and  their  associated  weights  that  have 
been  considered  in  a  decision  problem.  If  only  because  the 
model  is  explicit,  it  can  serve  an  important  role  in  facili- 
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tating  communication  among  those  involved  in  the  decision 
process.  With  a  decision  problem  structured  in  a  decision- 
analytic  framework,  it  is  an  easy  matter  to  identify  the 
location,  extent,  and  importance  of  any  areas  of  disagree¬ 
ment,  and  to  determine  whether  such  disagreements  have  any 
material  impact  on  the  indicated  decision.  In  addition, 
should  there  be  any  change  in  the  circumstances  bearing  upon 
a  given  decision  problem,  it  is  fairly  straightforward  to 
reenter  the  existing  problem  structure  to  change  values  or 
to  add  or  remove  problem  dimensions  as  required. 

It  should  be  emphasized  that  in  no  sense  does  decision 
analysis  replace  decision  makers  with  arithmetic  or  change 
the  role  of  wise  human  judgment  in  decision  making.  Rather, 
it  provides  an  orderly  and  more  easily  understood  structure 
that  helps  to  aggregate  the  wisdom  of  experts  on  the  many 
topics  that  may  be  needed  to  make  a  decision,  and  it  supports 
the  skilled  decision  maker  by  providing  him  with  logically 
sound  techniques  to  support,  supplement,  and  ensure  the 
internal  consistency  of  his  judgments. 

In  fact,  a  decision  analyst's  objective  is  to  facilitate 
the  decision  process  by  structuring  the  problem  with  the 
decision  maker  and  eliciting  the  values  and  probabilities  of 
the  decision  maker.  Thus,  the  decision  analyst  is  not  a 
surrogate  decision  maker  putting  together  a  study  that  is 
presented  to  the  real  decision  maker  upon  completion. 

Rather,  he  works  intimately  with  the  decision-making  body  to 
provide  them  a  structure  which  they  can  use  to  reach  the 
preferred  decision. 

2 . 1  Cost-Benefit  Analysis  for  Prioritization 

Cost-benefit  analysis  traditionally  has  two  distinct 
purposes.  The  first  is  to  determine  the  appropriateness  of 
undertaking  a  specific  action,  such  as  building  a  dam  or  a  new 
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plant,  by  determining  whether  the  benefits  outweigh  the 
costs  and  the  negative  side  effects.  This  is  generally  a 
difficult  undertaking  because  it  is  difficult  to  foresee  all 
the  dimensions  that  are  important  and  to  estimate  possible 
outcomes  in  terms  of  each  dimension.  The  second  purpose  is 
to  achieve  the  most  cost-beneficial  allocation  of  a  fixed 
level  of  resources  among  a  large  number  of  programs.  In 
this  case,  the  application  of  cost-benefit  analysis  is  more 
straightforward.  Basically,  the  relative  benefits  of  each 
program  must  be  quantified  and  reliable  cost  estimates 
obtained.  For  this  type  of  allocation,  the  relative  benefits 
of  these  programs  are  quantified  according  to  a  mission-oriented 
value  system,  not  a  monetary  (dollar)  value  system. 

Subjective  benefit  assessments  can  be  made  for  very 
diverse  programs  by  an  elicitation  procedure  that  motivates 
the  manager  of  a  set  of  programs  to  provide  his  true  subjec¬ 
tive  estimates.  Psychologists  and  decision  analysts  have 
observed  that  the  best  way  to  obtain  reliable  quantifications 
of  this  sort  is  to  use  paired  comparisons,  that  is,  to  ask 
the  expert  to  make  choices  between  two  packages  until  points 
of  indifference  can  be  found.  This  elicitation  procedure 
begins  with  the  quantification  of  benefits  for  sets  of 
similar  programs,  each  set  having  the  same  manager  or  sponsor 
who  is  an  expert  on  their  usefulness.  Once  these  benefit 
scales  have  been  assessed,  each  manager  is  asked  to  provide 
rationale  for  the  benefit  numbers  attached  to  his  programs. 

The  following  example  is  a  useful  i?.lustration  of  this 
procedure.  Suppose  there  are  ten  possible  decision  units, 
designated  A  through  J,  ranked  ordinal) y  as  proposed  by  the 
sponsor.  These  are  listed  in  Table  2-1,  along  with  an 
initial  benefit  scale,  total  cost,  and  initial  benefit/cost 
ratio.  First,  the  decision  unit  with  the  largest  benefit/ 
cost  ratio  is  selected,  then  the  order  in  which  the  remaining 
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PROCUREMENTS 

INITIAL 

BENEFITS 

TOTAL 

COSTS 

BENEFIT 

COST 

A 

100 

16 

6.2 

B 

99 

36 

2.8 

C 

95 

56 

1.7 

D 

90 

9 

10.0 

E 

37 

30 

2.9 

F 

83 

20 

4.2 

G 

70 

35 

2.0 

H 

70 

26 

2.7 

1 

60 

2 

30.0 

J 

55 

1 

55.0 

Table  2-1 

PROCUREMENTS  -  fNITIAL  COMPARISONS 
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units  would  be  prioritized  according  to  the  cost-benefit 
criterion  is: 


Ji  J.  I  D/  A/  F/  E/  G,  H/  G/  C. 

This  criterion  guarantees  that  for  any  budget  constraint, 
the  most  benefit  will  be  obtained.  Figure  2-1  illustrates 
the  difference  in  benefit  between  the  cost-benefit  and 
benefit-only  criteria  for  all  levels  of  cost.  Note  that 
using  the  cost-benefit  criterion  with  these  benefit  numbers 
is  almost  equivalent  to  ordering  the  decision  units  by  cost 
in  descending  order. 

The  second  iteration  of  this  process  begins  by  comparing 
decision  units  J,  1,  and  D  with  A.  The  package  J,  I,  and  D 
costs  nearly  as  much  as  A  but  should  be  twice  as  beneficial 
as  A.  However,  when  asked  which  he  preferred,  the  sponsor 
said  A  had  more  benefit  than  J,  I,  and  D.  So  A's  benefit 
was  adjusted  to  250  to  reflect  the  strength  of  his  preference. 

Next,  note  that  A  and  B  are  nearly  equivalent  to  J,  I, 

D,  A,  and  F  in  cost.  Since  A  is  common  to  both  packages, 
and  there  are  no  interdependencies  between  the  procurements, 

B  can  be  compared  to  J,  I,  D,  and  F.  In  this  case,  J,  I,  D, 
and  F  were  strongly  preferred,  and  the  sponsor  felt  B  was 
equivalent  to  J,  I,  and  D.  So  B's  benefit  was  raised  to 
215.  In  this  way,  paired  comparisons  are  used  to  reach  a 
level  of  indifference. 

Through  this  process,  the  sponsor  develops  a  concept 
of  a  true  zero  benefit  and  then  scales  the  relative  benefits 
of  his  progreuns  between  zero  and  one  hundred  (assigned  to  the 
most  beneficial  program) .  The  resultant  ratio-benefit  scale 
reflects  the  sponsor's  value  system. 
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More  iterations  of  the  paired-comparisons  procedure  were 
made  until  the  sponsor  was  happy  that  the  benefit  numbers 
reflected  his  judgment.  The  normalized  scale  is  presented 
in  Table  2-2.  The  final  order  of  cost-benefit  buys  is: 

J/  If  Df  Af  Bf  Gf  Ff  Cf  Ef  H. 

This  process  helps  the  sponsor  to  develop  substantive  ration¬ 
ale  for  supporting  the  final  benefit  scale  because  the 
judgments  he  has  to  make  require  more  thought  than  that 
typically  required  to  come  up  with  a  list  from  best  to 
worst. 

Figure  2-2  shows  the  final  differences  between  buying 
with  the  cost-benefit  criterion  versus  the  benefit-only 
criterion.  For  a  fiscal  constraint  of  $100,  the  cost- 
benefit  criterion  provides  68%  of  the  possible  benefit, 
which  is  a  33%  increase  over  the  benefit-only  criterion. 
Clearly,  to  use  the  cost-benefit  criterion  effectively  and 
to  be  considered  fiscally  responsible,  the  sponsors  must 
spend  considerable  time  producing  a  good  set  of  benefit 
numbers  with  the  spread  that  they  believe  truly  exists 
between  their  programs. 

After  these  benefit  scales  and  supporting  rationale 
have  been  assessed  for  each  sponsor,  a  group  of  individuals 
is  formed  to  provide  a  benefit  scale  across  the  diverse  set 
of  decision  units  formed  by  combining  the  lists  of  all  the 
sponsors.  This  cross-sponsor  group  must  have  a  clear  picture 
of  how  all  of  the  decision  units  might  benefit  the  Army's 
effectiveness.  Their  job  is  to  provide  a  benefit  scale 
for  a  small  subset  of  all  of  the  decision  units .  The  subset 
includes  one  item  from  each  of  the  sponsor's  lists,  and  the 
benefit  scale  provides  the  information  necessary  to  collapse 
all  of  the  individual  sponsor  benefit  scales  onto  one  scale. 
It  is  this  cross-sponsor  elicitation  of  benefits  that  moti- 
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COSTS 

PROCUREMENTS  (S) 


FINAL 

ORIGINAL  (NORMALIZED)  BENEFIT 

BENEFITS  BENEFITS  COST 


A 

16 

100 

100 

6.2 

B 

36 

99 

83 

2.3 

C 

56 

95 

80 

1.4 

G 

35 

70 

72 

2.1 

D 

9 

90 

58 

6.4 

E 

30 

87 

37 

1.2 

F 

20 

83 

30 

1.5 

H 

26 

70 

19 

0.7 

1 

2 

60 

15 

7.5 

J 

1 

55 

8 

8.0 

Table  2-2 

PROCUREMENTS  -  FINAL  COMPARISONS 


BENFFIT 


I 


Figure  2-2 

COST-BENEFIT  VS.  BENEFIT-ONLY  CRITERIA:  FINAL  COMPARISONS 
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vates  each  sponsor  to  provide  his  true  benefit  estimates. 

After  the  final  benefit  scale  is  elicited,  this  group  must 
provide  supporting  rationale.  All  of  the  rationale  and 
numerical  benefit  scales  provide  the  basis  for  the  cost- 
benefit  analysis  and  justification. 

As  an  illustration  of  this  cross-sponsor  benefit  scaling, 
consider  the  following  two-sponsor  example.  Each  sponsor,  1 
and  2,  has  four  decision  units  and  has  assigned  benefits  as 
shown  in  Figure  2-3.  The  cross-sponsor  group  is  asked  to 
compare  "B"  and  "0"  and  decides  that  "0"  is  twice  as  bene¬ 
ficial  as  "B"  (Figure  2-3) .  (Typically,  there  are  eight  to 
ten  sponsors,  and  the  iterative  benefit  assessment  procedure 
described  above  for  each  sponsor  is  used.)  This  comparison 
between  "B"  and  "0"  provides  enough  information  to  rescale 
all  of  sponsor  l*s  decision  units  onto  sponsor  2's  scale. 

Since  "B"  must  be  a  15  on  sponsor  2's  scale,  the  60  on 
sponsor  I's  scale  must  be  divided  by  15,  as  must  "A,"  "C," 
and  "D."  This  is  shown  on  Figure  2-4.  £f  a  sponsor  con¬ 
tracts  his  benefit  scale  more  than  his  true  preferences 
would  dictate,  his  programs  may  do  poorly  in  the  final 
analysis.  For  example,  if  sponsor  1  had  claimed  "B's" 
benefit  was  90  rather  than  60,  his  entire  scale  would  have 
to  be  divided  by  6  rather  than  4  to  be  consistent  with  the 
belief  that  "B"  is  half  as  beneficial  as  "0". 

The  cross-sponsor  benefit  judgments  are  more  difficult 
to  make  because  the  decision  units  are  much  more  diverse. 

For  this  reason,  the  cross-sponsor  group  is  asked  to  make 
two  or  three  cross-sponsor  scales,  using  different  decision 
units  from  each  sponsor's  list  each  time.  This  is  a  way  of 
triangulating  on  the  problem  that  forces  inconsistencies  to 
surface.  Finding  the  reasons  for  these  inconsistencies  and 
resolving  them  strengthens  the  final  result  so  that  it  is 
more  defendable. 
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SPONSOR  1  SPONSOR  2 


Once  the  final  cross-sponsor  benefit  scale  has  been 
chosen,  the  relative  benefits  of  all  of  the  decision  units 
are  made  explicit.  All  the  programs  have  been  scaled  in 
terms  of  benefit  on  a  corporate  scale.  Now  the  benefit/cost 
ratios  can  be  calculated  for  each  decision  unit,  and  the 
decision  units  prioritized  from  most  cost-beneficial  to 
least  cost-beneficial.  The  important  characteristics  are 
the  way  the  process  is  structured  and  the  defendability  of 
the  output. 

2 . 2  Multi-Attribute  Utility  Theory  for  Mission  Capabilities 

Analysis 

A  multi-attribute  utility  model  is  hierarchical  in 
nature,  starting  with  the  specified  top-level  factor  for 
which  an  overall  evaluation  is  desired.  This  factor  is 
successively  decomposed  into  subfactors  in  descending  levels 
of  the  hierarchy  such  that  each  successive  level  is  more 
specific  than  the  one  preceding.  At  the  lowest  level  of  the 
hierarchy  are  predictable  or  observable  technical  (or  other) 
characteristics  of  the  system  under  evaluation.  These 
lowest  level,  highly  specific  characteristics  are  typically 
system  parameters.  A  characteristic  of  this  decomposition 
is  the  appropriate  level  for  each  of  the  many  players  in 
this  decision-making  process. 

Multi-attribute  utility  analysis  (MAUA)  has  been  used 
to  assist  the  U.S.  Army  and  Air  Force  in  mission  capability 
analysis.  Currently,  this  methodology  is  in  use  by  the  U.S. 
Army  at  Fort  Monroe  as  part  of  the  Battlefield  Development 
Plan.  It  was  used  by  the  U.S.  Air  Force  and  Army  at  Langley 
Air  Force  Base  during  the  reconnaissance/surveillance  mission 
area  analysis  (MAA) .  (MAUA  has  also  been  used  in  numerous 
system  evaluations  for  the  Army  and  Navy.) 
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The  hierarchical  model  for  the  reconnaissance/surveillance 
MAA  is  depicted  in  Figure  2-5.  Performance  in  the  total 
mission  is  first  broken  into  two  environmental  descriptors, 
weather  and  countermeasures  (CM) .  The  four  environmental 
categories  are  day  clear  with  low  CM,  night  adverse  with 
medium  CM,  day  adverse  with  medium  CM,  and  all  weather  with 
high  CM.  The  four  weather  and  three  countermeasure  categories 
were  well  defined  and  measurable.  Next,  the  targets  are 
classified  as  either  mobile  or  fixed.  Mobile  targets  include 
troops,  tanks,  trucks,  etc.  Runways,  command  and  control 
posts,  and  missile  sites  are  examples  of  fixed  targets.  For 
each  type  of  target,  zones  representing  the  location  of  the 
targets  with  respect  to  the  forward  edge  of  the  battle  area 
(FEBA)  are  the  next  level  of  the  hierarchy.  The  five  zones 
for  mobile  targets  are  0-5  kms  back  from  the  FEBA,  5-50  kms , 
50-150  kms,  150-350  kms,  and  350-1000  kms.  The  four  zones 
for  fixed  targets  are  0-100  kms,  100-350  kms,  350-700  kms, 
and  700-1000  kms  back  from  the  FEBA.  In  the  next  level  of 
the  hierarchy,  the  military  purpose  for  the  information, 
that  is,  battle  management  or  the  execution  of  weapons 
against  targets,  is  specified.  The  level  below  this  enumer¬ 
ates  the  quantitative  and  qualitative  characteristics  of  the 
system.  The  two  quantitative  capabilities  are  the  area 
coverage  and  frequency  of  coverage  of  the  reconnaissance/ 
surveillance  systems.  Timeliness,  location  accuracy,  and 
detail  are  the  three  qualitative  capabilities  of  individual 
systems.  Each  of  these  bottom- level  characteristics  is 
defined  in  a  measurable  way. 

Value  functions  were  constructed  by  the  appropriate 
experts  for  each  of  the  quantitative  and  qualitative  capa¬ 
bilities  for  each  possible  combination  of  target,  zone,  and 
purpose,  assuming  a  1980  threat.  These  value  functions  were 
scaled  between  zero  and  100  and  were  assumed  to  be  indepen¬ 
dent  of  the  four  weather/countermeasure  classifications. 
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Area  Frequency  Timeliness  Location  Detail 
Coverage  of  Accuracy 

Coverage 


Figure  2-5.  Multi-Attribute  Utility  Model 
for  the  Reconnaissance/Surveillance  Mission 
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The  value  functions  were  developed  by  considering  the  per¬ 
centage  effectiveness  of  all  current  planning  methodologies 
(battle  management)  or  weapon  systems  (execution)  for  each 
value  of  a  given  characteristic,  such  as  location  accuracy. 
Therefore,  for  a  given  path  through  the  hierarchy,  the  zero 
value  for  location  accuracy  is  that  accuracy  that  is  not 
sufficient  for  any  weapon  system  or  planning  purpose  currently 
in  use.  The  value  of  location  accuracy  corresponding  in 
value  of  100  is  that  for  which  all  weapon  systems  or  planning 
would  be  used  to  their  optimum.  The  values  between  zero  and 
100  were  scaled  to  the  appropriate  values  of  location  accuracy 
representing  the  percentage  effectiveness  of  management  or 
execution.  Examples  are  shown  in  Figure  2-5. 

The  importance  weights  for  this  hierarchical  multi¬ 
attribute  utility  model  are  driven  by  the  characteristics  of 
the  threat.  So,  for  instance,  the  importance  weights  for 
zones  one  through  five  under  mobile  targets  reflect  the 
relative  capabilities  of  the  enemy's  mobile  military  equip¬ 
ment  in  each  zone.  Li)cewise,  the  relative  importance  of 
battle  management  and  execution  in  zone  three  for  mobile 
targets  determines  these  weights.  These  weights  are  also 
independent  of  the  weather  and  countermeasure  conditions. 
Experts  at  different  levels  of  the  decision-ma)cing  process 
would  be  aslced  to  assign  the  weights  where  their  expertise 
applied. 

The  reconnaissance/surveillance  MAA  taslc  force  used 
this  hierarchical  structure  to  evaluate  the  current  (1980) 
capability  at  all  of  the  bottom  levels.  Initially,  each 
reconnaissance/surveillance  system  was  evaluated  with  this 
model  in  order  to  gain  an  understanding  of  the  model  and  the 
systems.  U.S.  Army,  U.S.  Air  Force  (both  tactical  and 
strategic) ,  European,  and  national  systems  were  included. 

Then,  a  total  system  capability  for  each  of  the  entry  levels 
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to  the  model  was  defined  that  reflected  such  things  as  the 
number  of  each  system  in  the  field,  the  strengths  and  weak¬ 
nesses  of  each,  and  synergisms  between  systems.  Once  these 
assessments  were  completed,  judgments  were  made  concerning 
the  total  1980  reconnaissance/surveillance  capabilities  in 
each  zone  (both  for  mobile  and  fixed  targets)  for  both  the 
1984  and  1994  threat  and  attack  equipment. 

Finally,  the  total  deficiency  in  the  reconnaissance/ 
surveillance  mission  is  defined  as  the  unsatisfied  need 
times  the  value  of  the  need,  summed  over  all  of  the  MAA 
model's  paths.  The  unsatisfied  need  is  the  difference  in 
value  between  a  perfect  set  of  systems  and  the  current 
systems.  A  perfect  set  of  systems  would  score  100  points  on 
each  of  the  value  functions  in  the  model.  The  value  of  the 
needs  is  a  function  of  the  importance  weights  and  is  the 
value  of  going  from  a  worthless  (score  of  zero)  to  a  perfect 
system.  This  numerical  MAA  model  allows  the  task  force  to 
investigate  all  the  elements  of  the  mission  where  the  critical 
deficiencies  exist. 
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3.0  PRIORITIZATION  APPLICATIONS 


The  cost-benefit  methodology  (Section  2.1)  was  applied 
to  the  prioritization  of  both  the  PARR  issues  and  the  program 
development  incremental  pac)cages  (PDIP's)  for  POM-80.  This 
section  describes  these  two  applications,  both  of  which  are 
based  on  the  theses  that: 

o  Army  does  have  a  corporate  mission  value  system; 

o  the  benefit  elicitation  procedures  can  establish 
meaningful  benefit  relationships. 

The  Army  should  have  a  corporate  mission  value  system  for 
these  benefit  relationships  because  it  has  a  corporate  view 
of  the  threat.  The  set  of  attributes  to  be  considered  in 
assigning  an  overall  benefit  value  were: 

o  Army  goals, 

o  Army's  force  packaging  methodology, 

o  Marginal  increases  in  .  .  .  mobility,  sustain¬ 
ability,  training,  standardization,  interoperability, 

o  Urgency  of  need, 

o  Existing  levels  of  effort, 

o  Moral  obligations, 

o  Morale,  and 

o  Compliance  with  law. 
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These  attributes  were  not  exhaustive,  but  a  set  of  attributes 
was  specifically  excluded  from  consideration.  Examples  of 
these  are: 

o  OSD  directed  program/actions, 

o  Congressional  interest, 

o  National  or  regional  economics, 

o  Prior  commitments. 

Basically,  then,  the  benefit  numbers  were  to  reflect  the 
relative  contribution  of  the  decision  units  to  the  combat 
effectiveness  of  the  Army.  The  political,  economic,  and 
other  factors  were  excluded  during  the  elicitation  of  benefits. 
These  parameters  do  enter  the  process,  but  as  the  last  step 
by  the  decision  makers  at  the  highest  level.  (This  is  dis¬ 
cussed  further  in  Section  5.1.) 

This  procedure  will  be  applied  during  the  budget  process 
in  August  and  September,  and  the  application  will  be  reported 
upon  in  Section  3.3  when  completed. 


3.1  Program  Analysis  and  Resource  Review  (PARR)  Issue 


Prioritization 


3.1.1  Discussion  of  the  PARR  prioritization  -  The 
overall  goal  of  the  PARR  prioritization  was  to  rank  (in  a 
three-day  period)  334  PARR  issues  by  using  the  previously 
described  cost-benefit  methodology.  Fifteen  Army  Staff 
analysts  were  the  experts  who  specified  the  benefit  numbers. 
These  analysts  were  knowledgeable  of  the  PARR  issues  and 
familiar  with  the  six  Army  goal  categories  depicted  in 
Table  3-1.  The  PARR  issues  were  categorized  by  both  command 
and  functional  categories. 


22 


KIADIWCSS: 


11  WATO:  IKITUTIVES  DERIVED  EXCLUSIVELY 
TS^  the  MATO  KISSION 

12'  OTHER  OOKTIWENClESr  WlTlAnVES  THAT 
SUPPORT  OTHER  COHTLNCEHCIES  AS  WELL  AS 
THE  KATD  KISSIOK 

13  TRAINING  READINESS:  FRDCRAfC  THAT  REUTE 
INDIVIDUAL  PREPAREDNESS  VHETKER  IK  THE 
TRAIKINC  BASE  Oft  IN  OPERATIONAL  UNITS 

U  UNIT  READINESS;  CREW  AND  UNIT  TRAINING; 
OTHER  INITIATIVES  THAI  AFPECT  THE  ABILITY 
OP  A  UNIT  TO  PERFORM  ITS  DOCTRINAL  MISSION 

15  MATERIEL  READINESS:  PROCRA>C  REUTED  TO 
KAINTAININC  PRESCRIBED  OPERATIONAL 
READINESS  RATES  (OR) 

U  FORCE  READINESS:  PROCRA>6  THAT  DEVELOP 
TOE  MEASURES  REQUIRED  TO  IMPLIHENT  THE 
UADINESS  GOAL 


21  RBCRVITINC-.  INITIATIVES  TO  ATTRACT  AND 
BNROLL  INTO  ACTIVE  AND  RESERVE  COKPONOTTS 
CIVILIAN  recruitment 

22  RETATKIKG:  INITIATIVES  TO  RETAIN  QUALITk' 
PEOPLE?  EQUAL  OPPORTUNITY',  QUALITY  OP 
LIFE  SUPPORT;  RECOGNITION;  TELLING  THE 
STORY 

23  OTHER!  OTHER  PROGRAMS  THAT  OE'/ELOP  THE 
MEASJRES  REQUIREJ  TO  IMPLEMENT  THE  HUMAN 
GOAL 


31  NATO:  INITIATIVES  OESIGNTD  TO  IMPROVE  RSI 
ffr^ATO  PORCES, 

32  OTHER  ALLIES:  INITUTIVES  TO  SUPPORT 
national  POLia  in  conjunction  with  other 

ALLIED  FORCES 

33  SUPPORT:  INITIATIVES  APFECTINC  THE  SUPPLY 
AND  MAINTENANCE  SYSTEM  FROM  THE  PIELD  AftW 
TO  CONUS,  INCLUDING  HOST  NATION  CAPABILITIES 

3^  SUSTAIN;  SUSTAINABILITY  PROCRA>e ,  TO 
INCLUDE  PRODUCTION  BASE  REQUIREMENTS, 
EQUmOINT  AND  CONSUMABLES 

35  RESUPPLY:  RESUPPLY  PROGRAMS  (OTHER  THAN 
DIRECTLY  TO  PIELD  ARMY)  TO  SUPPORT  ALL 
LEVELS  WITH  A>WJNITI0K.  FUEL.  REPAIR  PARTS 
AND  SUBSISTENCE 

3*  OTHER:  PROCRA>6  THAT  DEVELOP  THE  MEASURES 
REQUIRED  TO  IMPLEMENT  THE  READINESS  OOAL 


6  MANAGEMENT; 


$I  BASE  OPERATIONS:  PROGRAMS  RELATED  TO 

INSTALLATION  RESOURCE  MANAGEMENT,  INCLUDING 
AITTOMATIOK  SECURITY 

62  ACTIVE  ARMY;  INITIATIVES  RELATED  TO  USE  OP 
AND  JUSTiriCATION  OP  END  STRENGTH  (RIOITRE- 
KENTS,  FORCE  STRUCTURE.  SUPPORT  PROCEDURES, 
HOST  NATION  SUPPORT) 

63  RESERVT  COMPONENTS :  PROCRA>C  DESICNFD  TO 
IMPROVE  THE  MANMNC,  TRAINING.  EpUIPPlNG, 
AND  READINESS  OP  RESERVT  COMPONENTS 

66  CIVILUNS?  PROCRA>6  RELATED  TO  USE  OF  END 
STRENGTH  AKd  INITIATIVES  TO  D'PROVE 
EFTICIDCY,  SUCH  AS  CONTRACTING  POLICIES 

65  yrSTEMS-  INITIATIVES  RELATED  TO  SYSTEMS 
HAMAGEMEKT  OF  RESOURCES 

66  OTHER-  PROGRAMS  THAT  DEVELOP  THE  MEASURES 
REQUIRED  TO  IMPLEMENT  THE  MANAGEMENT  GOAL 


STRATEGIC  ABILITY: 

41  DEPLOYMENT:  INITIATIVES  RELATED  ID  DEPLOY- 
MDT  PLANS,  ORCANIEATIOK,  MARSHALLING, 

LIFT,  OPDIATINC  PROCEDURES  AND  RECEPTION 
PLANS  ON  ARRIVAL  AT  DESTINATION 

42  PDMCUSt  PROCRA>ffi  REUTED  TO  ACQUIRING 
TRANSPORTING,  STORING  AND  MAINTAINING 

TOHCUS  STOCKS 

43  OTHER:  PROCRA^C  THAT  DEVELOP  THE  MEASURES 
REQUIRED  TO  IKPLEKENT  THE  STRATEGIC  WBILITY 
COAL 


YCDERNIEATlOK/mVRE  DrvTLOPMENT: 

51  TECHNOLOGY:  PROGRAMS  THAT  EXPLOIT  NEV 
TttWCLOW  TO  ENHANCE  RSI 

52  TACTICS;  PROGRAMS  THAT  SUPPORT  DEVELOPMENT/ 
REFINEMENT  OP  TACTICS/TECKNIQUES  ASSOCUTE2) 
WITH  N£V  EQUIPMENT 

53  DOCTRINE:  INITIATIVES  THAT  REIATE  TO  DOC¬ 
TRINAL  DEVELOPMENT  WITH  OTHER  SERVICES 
AND  WITH  ALLIES 

54  EDUIPMEKT:  PROGRAMS  THAT  IDEVTIFY  REQUIRE¬ 
MENTS  FOR  NEV^IMPROVTD'MODiriED  EQUIPMENT 
(INCLUDES  MAINTENANCE,  RESUPPLY  AND 
INDIVIDUAL/UKIT  TRAINING  REQUIREMENTS 
DERIVED  PROM  INTEGRATED  SYSTEMS  APPROACH  TO 
DEVELOPING  NDJ  EQUIPMENT  AKD  WTAPONS) 

55  AUTOMATION:  INITIATIVES  REUTED  TO  DEVTLOP- 
MENT,  ACQUISITION  AJ;D  CSM  OP  IKPOR-'^ATION 
SYSTEM  FOR  THE  TACTICAL  AND  SUPPORT 
EMVIRDNMENTS 

56  ORGASILATION:  INTTUTIVES  THAT  APPLY 
TACTlCAL/fiOCTRIKAL  CHANGES  TO  ORCAKIUTIONAL 
STRUCTURE 

57  OTHER:  PROGRAMS  THAT  DEVTLOP  THE  MEASIRES 
REQUIRED  TO  IMPLEMENT  THE  FUTURE  DEVtLOP* 
KENT  OOAL 


Table  3-1.  Functional  Categories 
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Prior  to  this  prioritization,  nearly  800  PARR 
issues  underwent  a  Sieve  Analysis  during  which  the  following 
PARR  issues  were  removed  from  consideration:  1)  Issues 
funded  within  basic  levels  of  the  major  commands  (MACOMs) ; 

2)  issues  included  in  PDIPs;  and  3)  issues  non-supported  by 
the  Staff.  The  result  of  this  Sieve  Analysis  was  the  set  of 
334  PARR  issues  to  be  prioritized. 

The  first  step  in  the  prioritization  was  to 
establish  a  "marker"  list  of  approximately  80  representative 
PARR  issues.  Table  3-2  is  a  categorization,  by  functional 
category  and  by  command,  of  the  87-item  marker  list  which 
was  settled  upon  by  the  participants.  For  this  analysis,  the 
Material  and  Strategic  Mobility  categories  were  combined 
into  one  single  category. 

Having  established  the  87-item  set  of  markers, 
the  next  step  was  to  evaluate  the  benefits  for  each  of  the 
19  subsets  of  marker  items.  This  benefit  assessment  was 
done  by  command  and  within  categories.  For  example,  the 
EUR-KOR  Command  was  required  to  establish  benefits  for  its 
nine  readiness  items  by  first  giving  what  was  believed  to  be 
the  most  important  single  item  a  benefit  of  100  and  then 
adjusting  the  benefits  of  the  other  eight  readiness  items 
appropriately.  The  other  commands  similarly  established 
benefits  for  their  marker  list  PARR  issues  within  each  of 
their  functional  categories. 

The  next  step  in  establishing  the  overall  list 
of  benefits  for  the  marker  list  was  to  combine  the  marker 
items  from  each  command  into  a  single  list  for  each  functional 
category.  To  accomplish  this  task  for  each  functional 
category,  command  analysts  met  and  adjusted  the  benefits  of  a 
single  highly  beneficial  item  in  each  command  to  some  mutually 
agreeable  magnitudes.  Next,  items  from  the  middle  of  each 
command's  benefit  list  were  mutually  adjusted  in  benefit. 
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Table  3-2 

BREAKDOWN  OF  "MARKER"  LIST 


Finally,  a  similar  adjustment  was  made  for  items  ranking  low 
on  each  command's  benefit  list.  After  the  three  adjust¬ 
ments,  comparisons  were  made  to  see  if  they  reflected  the 
same  benefit  proportionality  among  commands.  If  not,  re¬ 
adjustments  were  made  both  within  and  between  command  lists 
until  a  final  between-sponsor  proportionality  was  achieved. 

The  remaining  items  in  each  command's  category  list  were 
then  rescaled  to  correspond  with  the  new  benefits  for  the 
previously  rescaled  items  on  each  list.  Each  command's 
portion  of  PARRs  for  the  designated  category  was  directly 
integrated  to  form  a  single  category  marker  list.  The 
participants  were  allowed  to  review  each  integrated  category 
marker  list  and  alter  the  benefits  until  a  level  of  indiffer¬ 
ence  among  combinations  of  packages  was  achieved.  Any  move¬ 
ment,  however,  required  the  mutual  consent  of  the  participants. 

At  this  point  in  the  analysis,  there  existed 
five  separate  marker  lists,  each  corresponding  to  a  different 
functional  category.  The  next  step  in  the  analysis  was  to 
combine  the  separate  category  marker  lists  i.nto  an  overall 
marker  list.  To  perform  this  task,  the  relative  magnitudes 
of  the  items  with  high,  medium,  and  low  benefit  on  each 
category  marker  list  were  adjusted.  An  iteration  to  establish 
consensus  levels  of  indifference  on  these  adjustments  then 
took  place,  and  the  remaining  items  on  the  lists  were  then 
rescaled  appropriately.  The  category  marker  lists  were 
combined  into  the  final  overall  marker  list,  and  all  partici¬ 
pants  were  then  given  the  opportunity  to  adjust  the  benefits 
of  any  items  on  the  list.  Once  again,  these  adjustments 
could  be  performed  only  by  mutual  consent. 

The  cost-benefit  implications  of  the  benefits 
assessed  for  the  marker  list  were  then  calculated,  and  the 
participants  were  given  the  opportunity  to  once  again  adjust 
the  benefits  for  these  items.  For  the  first  time,  the 
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real  meaning  (in  a  cost-benefit  sense)  of  the  benefit 
assessments  surfaced,  and  as  a  result,  some  drastic  changes 
in  benefit  assessments  took  place.  (The  chief  problem 
uncovered  with  the  first  set  of  benefits  was  that  the  range 
of  the  benefit  scale  was  much  smaller  than  the  range  of  the 
cosu  scale.  Since  most  participants  felt  this  to  be  untrue, 
the  benefit  scale  was  expanded.  As  always,  benefit  altera¬ 
tions  were  made  only  through  mutual  consent  of  all  partici¬ 
pants.  The  result  at  this  point  was  a  benefit  scaling  of 
all  87  marker  issues.  The  successive  iterations  described 
above  had  converted  an  ordinal  ranking  to  a  numerical  ratio 
scale  of  benefits.  This  benefit  scale  could  now  be  compared 
to  the  cost  scale  so  that  a  cost-beneficial  prioritization 
could  be  established. 

Table  3-3a,  b  contains  the  final  listing  for  the 
marker  issues  sorted  by  benefit  alone  and  by  cost-benefit. 
Figure  3-1  contains  a  plot  of  cumulative  cost  versus  cumula¬ 
tive  benefit,  based  on  the  table.  The  lower  curve  in  this 
figure  assumes  that  items  are  purchased  in  order  of  benefit, 
highest  to  lowest;  the  top  curve  assumes  purchasing  in  the 
order  from  lowest  to  highest  cost/benefit  ratio.  The  two 
plots  clearly  illustrate  the  tremendous  gain  in  accrued 
benefit  which  results  when  the  cost-benefit  rather  than  the 
benefit-only  purchasing  strategy  is  used. 

Before  the  prioritization  continued  into  the 
phase  of  integrating  the  247  remaining  PARR  issues  into  the 
marker  list,  the  participants  were  asked  to  supply  rationale 
for  the  relative  placements  of  a  portion  of  the  marker  items 
with  respect  to  one  another  in  the  category  marker  lists. 

The  final  step  in  establishing  the  benefit  list 
was  to  integrate  the  247  remaining  PARR  issues  with  those 
contained  in  the  marker  list.  This  integration  was  performed 
by  functional  category.  That  is,  the  remaining  PARR  issues 
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Table  3-3b.  "Marker"  Issues  Sorted  by  Cost-Benefit 
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BENEFIT 


1980  COST  (S  B) 


Figure  3,1 

st-Benefit  versus  Benefit-Only  Criteria — 
PARR  Issue  "Marker”  List 
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for  each  functional  category  were  compared  with  issues  of 
the  same  functional  category  in  the  marker  list  and  assigned 
benefits.  Hence,  this  process  produced  five  separate  lists 
of  PARR  issues  (one  for  each  functional  category)  whose 
benefits  had  been  assigned  on  a  common  scale. 

Before  integrating  these  five  lists  into  a  final 
overall  benefit  list,  the  benefit  lists  by  category  were 
rank  ordered  with  respect  to  benefit  and  cost-benefit-  The 
costs  assessed  were  the  FY  80  costs  in  thousands  of  dollars. 
The  participants  were  then  allowed  to  study  the  implications 
of  these  lists  in  terms  of  purchasing  priority,  and  to 
adjust  benefit  values  which  led  to  seemingly  inappropriate 
implications.  All  adjustments  were  performed  only  by  mutual 
consent  among  participants,  and  supporting  rationale  was 
provided . 


The  final  step  in  the  exercise  was  to  combine 
the  category  benefit  lists  into  a  total  PARR  issue  list. 
Although  cross-referencing  among  the  five  category  lists 
could  provide  the  same  amount  of  information,  one  single 
overall  list  made  it  easier  to  perform  a  final  validation  of 
benefit  values  and  their  implications.  In  this  final  itera¬ 
tion,  benefit  values  could  once  again  be  adjusted  by  mutual 
consent  of  participants.  The  final  overall  benefit  list 
could  be  used  to  establish  buying  priorities  for  all  PARR 
issues  across  all  functional  categories. 

Figure  3-2  displays,  for  the  overall  list  of  334 
PARR  items,  the  cumulative  cost  versus  cumulative  benefit 
for  both  benefit  only  and  cost-benefit  purchasing  strategies. 
Once  again,  this  display  makes  overwhelmingly  clear  the 
tremendous  advantage  in  terms  of  benefit-purchasing  power  to 
be  gained  from  the  cost-benefit  versus  the  benefit-only 
purchasing  strategy. 
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The  final  results  of  this  PARR  issue  analysis 
and  prioritization  were  an  overall  list  of  PARR  issues 
ordered  by  benefit,  an  overall  list  of  PARR  issues  ordered 
by  cost-benefit,  and  a  set  of  supporting  rationale  for  the 
marker  issues. 

Before  blindly  accepting  these  data  and  using 
them  to  guide  PARR-issue  spending  decisions,  one  should  note 
several  cautions.  First,  the  benefit  assessments  are  sub¬ 
jective  and  represent  no  more  or  less  than  highly  knowledge¬ 
able  but  nonetheless  fallible,  analysts'  judgments.  Second, 
the  cost  data  used  in  the  analysis  included  only  one-year 
costs,  and  manpower  costs  were  not  included  in  the  PARR 
data.  In  addition,  manpower  constraints  were  not  considered 
in  assessing  costs  or  benefits.  Finally,  the  entire  analysis 
was  performed  in  an  exceedingly  short  (three  day)  period. 

In  spite  of  the  above  limitations,  this  analysis 
nevertheless  has  a  number  of  strong  points  and  potential 
uses.  First,  the  analysis  supplies  a  sound  starting  point 
in  the  decision  process  on  the  PARR  issues.  Second,  the 
cost-benefit  consequences  are  clearly  visible,  and  the 
process  used  in  deriving  them  is  a  visible  and  reproducible 
one.  Third,  the  analysis  can  be  used  as  a  communication 
aid,  both  in  bringing  into  focus  contentious  PARR  issues  and 
in  building  a  defense  of  PARR  issues  in  the  overall  Army 
program  development. 

3.1.2  Rethinking  the  PARR  drill  -  The  PARR  drill  can 
be  looked  upon  as  a  largely  successful  effort  during  which 
all  involved  personnel  made  optimal  use  of  the  short  period 
of  time  allotted  to  them.  In  the  future,  this  exercise 
should  be  allotted  at  least  a  full  week,  and  the  following 
steps  should  be  followed; 
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1. 


Prior  to  the  exercise,  common  task-specific  defi¬ 
nitions  should  be  established.  This  would  ensure 
that  similar  items  from  the  various  commands 
appear  in  the  same  functional  categories. 

2.  An  education  period  should  precede  the  exercise 
during  which  - 

a)  All  PARR  issues  are  clearly  explained  and 
understood;  this  includes  all  issues,  not 
just  potential  marker  list  issues. 

b)  Concise  descriptions,  in  terms  of  "output" 
are  written  for  all  issues. 

c)  The  cost  data  are  organized  and  validated. 

3.  The  Army  staff  should  select  the  marker  issues  and 
verify  that  they  cover  the  full  range  of  costs  and 
benefits  (functional  category  priorities) . 

4.  The  Army  staff  should  develop  benefit  values  for 
marker  items  with  each  functional  category.  As  a 
rule  of  thumb,  the  benefit  values  should  have 
roughly  the  same  range  as  the  costs  of  the  issues. 

5.  The  staff  should  provide  the  marker  lists  to  PAE, 
and  PAE  should  integrate  the  separate  marker  lists 
into  a  single  master  marker  list. 

6.  The  staff  and  PAE  should  convene  to  resolve  master 
marker  list  priorities. 

7.  The  master  marker  list  priorities  should  go  before 
the  PGRC  for  approval. 
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8.  The  staff  should  develop  benefit  values  for  all 
issues  in  each  functional  category  and  integrate 
these  into  the  category  benefit  lists. 

9.  The  staff  should  provide  the  total  integrated 
issue  lists,  by  functional  categories,  to  the  PAE 
for  integration  into  the  final,  total  prioritized 
issue  list. 

If  the  above-suggested  sequence  of  steps  is 
followed,  the  PARR  prioritization  drill  should  provide 
maximum  information  to  those  individuals  engaged  in  decision 
making  with  respect  to  PARR  issue  expenditures. 

3.1.3  Inter-expert  reliability  -  Since  the  relative 
benefit  numbers  that  are  used  in  the  cost-benefit  analysis 
are  the  result  of  careful  expert  judgment,  the  question  of 
inter-expert  reliability  is  often  raised.  That  is,  how  much 
agreement  can  be  expected  between  the  benefit  numbers  of  two 
qualified  experts  (or  in  the  case  of  this  type  of  exercise — 
two  different  groups  of  experts) .  This  question  has  not 
been  investigated  under  the  controlled  conditions  of  an 
experiment;  although  it  certainly  could  be  done.  However, 
two  independent  benefit  scales  for  106  of  the  334  PARR  issues 
were  developed.  One  of  these  scales  was  derived  by  the  PARR 
issue  prioritization  that  has  just  been  discussed.  The  second 
scale  was  developed  by  individuals  within  seven  directorates 
of  DCSOPS.  These  individuals  were  briefed  on  the  procedure 
by  other  members  of  DCSOPS  so  that  the  approach  used  for 
this  prioritization  was  the  same  as  that  described  in  Section 
2.1.  Namely,  each  directorate  developed  a  benefit  scale  for 
the  PARR  issues  it  sponsors  and  then  the  seven  benefit  scales 
were  merged  into  a  single  scale.  Figure  3-3  shows  the  agree¬ 
ment  of  these  two  benefit  scales;  each  point  representing 
the  benefit  numbers  of  the  two  groups  for  a  single  PARR  issue. 
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The  correlation  coefficient  between  these  two  scales  is 
0.70,  which  suggests  significant  though  not  striking  agree¬ 
ment.  It  is  likely  that  a  controlled  experimental  investi¬ 
gation  of  inter-expert  reliability  produces  results  as  good 
if  not  better  than  these. 

3 . 2  POM  Issue  Prioritization 

In  the  POM  drill,  a  cost-benefit  prioritization  of  all 
of  the  PDIP's  being  considered  in  the  actual  POM  was  developed — 
a  total  of  about  185.  There  were  ten  sponsors  or  proponents: 

1.  DCSOPS  Deputy  Chief  of  Staff  for  Operations 

2.  DCSRDA  Deputy  Chief  of  Staff  for  Research, 

Development,  and  Acquisition 

3.  DCSPER  Deputy  Chief  of  Staff  for  Personnel 

4.  OCAR  Office  of  the  Chief  of  Army  Reserve 

5.  NGB  National  Guard  Bureau 

6.  AAD  Army  Automation  Directorate 

7.  DCSLOG  Deputy  Chief  of  Staff  for  Logistics 

8.  OCE  Office  of  the  Chief  of  Engineers 

9.  PA&ED  Program  Analysis  and  Evaluation  Directorate 

10.  OTSG  Office  of  the  Surgeon  General 

Clearly,  the  spectrum  of  PDIP's  supported  by  these  proponents 
is  wide,  as  evidenced  by  the  examples  in  Table  3-4.  Summary 
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SPONSOR 

PDIP  TITLE 

DCSOPS 

National  Training  Center 

NATO  Forward  Deployed  Readiness 

DS/GS  Maintenance  (USAREUR/FORSCOM) 
USAREUR  DIV  ALO  Increase 

Flying  Hour  Program 

U.S.  Contribution  to  NATO  Military 
Budget 

DCS  RDA 

M60  Tank  Production 

GSRS 

REMBASS 

Air  Cushion  Vehicle  (ACV) 

DCSPER 

Quality  of  Life  Enhancement/ELIFE 

TAG  No.  1 

Women  in  the  Army  (WITA) 

Decision  Package  Set  No.  40 

Training  Developments  -  Current 

Program 

Civilian  Training,  Education,  and 
Development  Program 

Organizational  Effectiveness 

OCAR 

USAR  Readiness  (M  to  M  +  30) 

NGB 

i 

M  to  M  +  30  Force  | 

AAD 

Readiness 

Automation  Modernization 

Mobilization 

Automation  Interoperability 

Project  VIABLE,  Phase  1 

Automation  Modernization  I 

Automation  Modernization  II 

Table  3-4.  Representative  Sample  of  PDIPS 


38 


1 

j  SPONSOR 

PDIF  TITLE 

1 

!  DCS  LOG 

1 

1 

j 

Support  Readiness  -  Property  Account¬ 
ability  ) 

NATO  Task  Force:  Consumer  Logistics  j 

1 

i 

!  OCE 

i 

i 

j 

! 

1 

( 

1 

Training/Operational  Efficiency  -  j 

MCA  Sub-Package 

Construction  in  Panama  -  MCA 

Sub-Package 

Korea  Relocation  -  MCA 

Backlog  of  Maintenance  and  Repair  - 
Europe 

1 

j  PA&ED 

1 

( 

1 

( 

j 

Readiness  #1  (PARR's) 

Management  #1  (PARR’s) 

Modernization  #1  (PARR’s)  ^ 

Materiel  #1  (PARR’s) 

Human  #1  (PARR’s) 

1  OTSG 

! 

I 

Preposition  18  Reserve  Component  General 
Hospitals  in  Europe 

Military  Occupational  Health/Safety 
Hazards 

International  Health  Initiatives 

.  _ ! 

Table  3-4.  Representative  Sample  of  PDIPS 

(Continued) 
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sheets  for  PDIP's  prepared  by  the  proponents  contained  a 
funding  profile,  narrative  description,  and  rationale/analysis 
for  the  benefit  numbers  of  the  PDIP. 


The  PDIP's  of  AAD  provide  a  useful  illustration  of  the 
relative  benefits  ascribed  by  each  proponent  to  his  PDIP's. 
AAD's  PDIP's  are  described  in  Table  3-5  in  terms  of  five- 
year  cost,  relative  benefit  numbers,  and  benefit/cost  ratio. 
With  these  costs  and  benefits,  the  cost-benefit  priority 
order  for  AAD's  PDIP's  was: 

1.  Interoperability 

2.  VIABLE 

3.  Modernization  I 

4.  Modernization  II 

5.  Readiness 

6.  Mobilization 

7.  Modernization 

This  priority  list  was  supported  by  AAD.  The  benefits 
reflect  the  following  judgments: 

o  VIABLE  is  equal  to  the  other  six  PDIP's  in  benefit. 

o  Interoperability  is  over  twice  as  beneficial  as 

the  combination  Modernization  I  and  II,  Readiness, 
Modernization,  and  Mobilization. 

o  Modernization  II  is  slightly  more  beneficial  than 
Modernization  I,  Readiness,  and  Mobilization. 

o  Modernization,  Modernization  I,  and  Readiness  are 
more  beneficial  than  Modernization  II. 

o  Readiness  is  equal  in  benefit  to  Modernization  and 
Mobilization. 
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PDIP 

5-YEAR 

COST 

BENEFIT 

BENEFIT/ 

COST 

VIABLE 

147. 

100. 

0.68 

Interoperability 

30. 

70. 

2.3 

Modernization  II 

35. 

13. 

0.37 

Modernization  I 

18. 

7. 

0.39 

Readiness 

20. 

5. 

0.25 

Modernization 

232. 

4.5 

0.019 

Mobilization 

19. 

0.5 

0.26 

Table  3-5.  AAD's  Relative  Costs  and  Benefits 


The  benefit  numbers  for  all  of  the  sponsors  were  elicited 
over  a  two-week  period  by  interacting  with  the  action  officers 
of  each  proponent. 

Two  cross-sponsor  benefit  scalings  were  assessed  on  a 
Saturday  morning  from  the  "Rump"  PGRC  {Program  Guidance 
Review  Committee) .  The  rules  of  engagement  for  this  cross¬ 
sponsor  session  are  presented  in  Figure  3-4.  These  two 
scales  contained  a  number  of  inconsistencies  that  were 
discussed  with  the  "Rump"  PGRC  and  resolved  the  next  Monday 
by  the  action  officers.  Table  3-6  provides  an  implied 
cross-sponsor  benefit  scale  for  one  PDIP  from  each  sponsor's 
list  in  Table  3-4.  The  implied  benefit  scale  is  derived 
from  the  final  benefit  numbers  of  this  POM  prioritization. 

A  set  of  judgments  similar  to  those  discussed  above  for 
packages  of  AAD's  PDIP's  can  be  constructed  for  these  cross¬ 
sponsor  PDIP's. 

Following  the  cost-benefit  analysis,  additional  parameters 
discussed  at  the  beginning  of  3.0  were  considered.  The 
resulting  deviations  were  both  visible  and  quantifiable  to  the 
top-level  decision  makers.  Thus,  the  impacts  of  political 
and  other  legitimate  (non-mission)  parameters  are  visible. 

This  visibility  provides  the  top-level  decision  makers  with 
a  means  to  grade  their  efforts. 

Figure  3-5  presents  a  graphical  comparison  of  the  two 
prioritizations.  The  vertical  axis  represents  accumulated 
benefit  as  PDIP's  are  bought  by  each  prioritization.  The 
horizontal  axis  represents  accumulated  five-year  cost.  At 
the  decremented  level  of  funding,  the  POM  order  accounts  for 
only  half  the  benefit  that  the  cost-benefit  order  does.  The 
POM  order  is  very  similar  to  the  cost-benefit  order  between 
the  decrement  and  basic  levels.  As  a  result,  the  POM  order 
results  in  two-thirds  the  benefit  of  the  cost-benefit  order. 
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SPONSOR  BENEFIT  ORDER  HAS  BEEN  SET  BY  THE  SPONSOR 
AND  DOES  NOT  CHANGE  DURING  CROSS-SPONSOR  ASSESS¬ 
MENT  . 


SPONSOR  MAY  CHANGE  BENEFIT  NUMBERS  ONLY  TO 
RESOLVE  INCONSISTENCIES. 


INCONSISTENCIES  CAN  BE  RESOLVED  BY  CHANGES  IN 
CROSS-SPONSOR  BENEFIT  ASSESSMENTS  (ITERATIONS 
1  AND  2)  AND/OR  SPONSOR  BENEFIT  ASSESSMENTS. 
GROUP  DELPHI  TECHNIQUES  WILL  BE  USED  TO  ^^AKE 
CHANGES  IN  CROSS-SPONSOR  BENEFIT  ASSESSMENTS. 
THE  SPONSOR  WILL  BE  SOLELY  RESPONSIBLE  FOR 
CHANGES  IN  HIS  BENEFIT  ASSESSMENTS  TO  RESOLVE 
INCONSISTENCIES. 


SPONSOR  HAS  SOLE  RESPONSIBILITY  FOR  HIS  PDIP 
STATEMENTS  OF  RATIONALE  AND  ANALYSIS.  SPONSOR 
MAY  CHANGE  HIS  STATEMENTS  TO  RESOLVE  INCONSIS¬ 
TENCIES. 


Figure  3-4.  Rules  of  Engagement  for 
Cross-Sponsor  Benefit  Scaling 
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CROSS-SPCNSOR  5-YEAR  BENEFIT 

SPONSOR  PDIP  BENEFIT  COST  COST 
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Table  3-6.  Cross-Sponsor  Benefit  Scale 


BENEFIT  ACCUM. 


PROGRAM  EVALUATION 


Deviations  .  .  .  due  to 

•  SOME  OSD  DIRECTED  INITIATIVES 

•  MUST  PAY  BILLS 

•  PROGRAM  IMBALANCE 


Figure  3-5 

COMPARISON  OF  POM  WITH  COST-BENEFIT  ORDER 
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Several  reasons  for  these  differences  are  also  listed  in 
Figure  3-5. 

Since  OSD-directed  initiatives,  program  imbalance,  and 
so  on  are  facts  of  life,  this  POM  prioritization  was  repre¬ 
sented  to  the  decision  makers  as  a  good  place  to  start  but 
not  the  final  answer.  Reasons  for  this  recommendation  are: 

o  Benefit  numbers  represent  only  the  Army's  effec¬ 
tiveness.  Other  attributes  involving  political, 
economic,  and  other  issues  must  be  considered. 

o  Some  of  the  PDIP's  were  dependent  upon  one  another, 
such  as  the  (1)  creation  and  (2)  deployment  of  a 
major  unit. 

o  Only  the  five-year  POM  costs  were  used.  Abnormally 
high  outyear  costs  of  certain  PDIP's  should  be 
used  to  reduce  their  priority. 

o  Manpower  constraints  have  to  be  considered  in  the 
final  prioritization. 

o  This  analysis  is  only  conducted  at  the  margin  and 
therefore,  does  not  flush  out  "gold  watches"  (soft 
programs)  in  the  core. 

Additionally,  this  cost-benefit  prioritization  was  used  by 
the  decision  makers  to  determine  how  to  spend  $189M  that  had 
not  been  specifically  earmarked  in  FY  80  in  the  basic  level 
that  had  been  built  into  the  initial  POM  prioritization. 

This  enabled  the  decision  makers  to  move  the  POM  priority 
order  closer  to  the  cost-benefit  prioritization. 
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3. 3  Rethinking  the  POM  Prioritization 


There  are  three  major  areas  where  better  planning  can 
significantly  improve  this  process.  They  are:  (1)  packaging 
the  decision  units,  (2)  determination  of  costs,  and  (3)  benefit 
elicitations . 

3.3.1  Packaging  the  decision  units  -  Improving  the 
packaging  of  decision  units  involves  several  issues.  First, 
the  decision  units  must  be  structured  independent  of  one 
another  in  terms  of  benefit  and  cost.  Adding  a  force  struc¬ 
ture  element  and  deploying  r.hat  element  should  not  be  in 
separate  decision  units. 

Next,  the  elicitation  of  benefits  requires  that 
the  appropriate  people  be  familiar  with  each  issue.  Although 
this  was  generally  true  for  most  of  the  PDIP's  that  were  con¬ 
sidered  for  POM-80,  it  was  not  true  for  the  PARR  PDIP's  or 
others  which  contained  numerous  disparate  items.  Since  the 
Army  is  such  a  large  organization  and  the  aggregation  of 
decision  units  is  necessary  to  have  efficient  management, 
the  packaging  of  decision  units  should  be  a  hierarchical 
process.  As  one  organizational  element  receives  decision 
units  from  several  lower  level  elements,  it  repackages  the 
decision  units  using  cross-element  benefit  numbers  and  the 
information  provided  by  the  lower  elements  about  their 
decision  units.  This  structure  already  exists  within  the 
Army  staff;  the  problem  is  determining  the  best  way  to  make 
it  work  for  this  process.  Clearly,  this  process  must  be 
started  early  (October  or  November) ,  with  the  publication 
of  the  draft  Army  Planning  Programming  Guidance  Memorandum. 

This  document  provides  uniform  guidance  on  the  decision 
process  to  the  organization.  Improved  packaging  structure 
should  preclude  the  haphazard  formulation  of  PDIP's  as  well 
as  ensure  that  items  within  a  PDIP  are  similar  in  cost- 
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benefit  so  that  some  soft  programs  do  not  get  a  "free  ride 
with  good  programs. 


If,  in  future  years,  the  POM  analysis  is  going 
to  be  done  at  the  margin,  as  was  done  this  year,  identifying 
exactly  what  is  in  the  core  and  communicating  this  to  the 
appropriate  elements  of  the  hierarchical  organization  is  a 
third  point  that  needs  improvement.  This  has  two  beneficial 
aspects.  First,  this  information  is  useful  to  the  sponsors 
and  cross-sponsors  in  assigning  benefits  because  it  helps 
define  exactly  how  the  Army  will  be  different  if  a  given 
PDIP  is  funded.  Most  of  the  PDIP's  were  tips  of  icebergs, 
the  remainder  of  the  iceberg  being  located  in  the  core.  It 
is  important  that  people  know  the  relative  utility  of  the 
visible  portion  contained  in  the  PDIP.  Secondly,  this  close 
examination  of  the  core  is  the  best  method  for  uncovering 
soft  programs. 

3.3.2  Determination  of  costs  -  The  determination  of 
costs  includes  two  aspects.  First,  the  five-year  POM  costs 
were  used  as  the  cost  of  the  PDIP's  this  year  when  the 
incremental  life  cycle  cost  should  have  been  used.  The 
benefits  of  a  PDIP  corresponded  to  the  life  cycle  benefit 
associated  with  the  tip  of  the  icebert  defined  by  that  PDIP. 
Therefore,  the  life  cycle  cost  associated  with  the  tip  of 
each  iceberg  should  be  used  as  the  cost  of  that  PDIP. 

Clearly,  many  of  these  costs  will  not  be  incurred  until  the 
1990's  and,  therefore,  estimates  of  them  will  be  very  soft. 
Likewise,  there  are  indirect  costs  associated  with  many  pro¬ 
grams  that  should  be  factored  in  but  are  hard  to  estimate. 
These  costs  should  be  estimated  and  used  in  the  cost-benefit 
prioritization,  with  the  awareness  that  the  priority  location 
of  the  decision  units  with  the  softest  costs  can  be  identi¬ 
fied  as  an  issue  and  discussed  at  any  point  in  the  process. 
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Second,  constant  dollars  are  the  appropriate 
dollars  to  use  in  calculating  the  life-cycle  cost  of  the 
decision  units.  Then  year  or  FYDP  dollars  overemphasize 
the  importance  of  dollars  in  the  future.  Discounting  constant 
dollars,  on  the  other  hand,  underemphasizes  the  importance 
of  dollars  in  the  future. 

3.3.3  Benefit  elicitation  -  The  elicitation  of  benefits 
should  be  done  over  a  longer  period  of  time  than  was  given 
the  sponsors  and  the  cross-sponsor  group  during  both  the  PARR 
and  POM  prioritizations.  This  can  easily  be  accomplished  with 
advanced  planning,  and  a  week  or  more  is  recommended  for  the 
PARR  issues  and  two  months  (1  February  -  1  May)  for  the  POM 
prioritization.  The  major  improvement  to  be  made  is  the 
specification  of  a  simple  framework  to  replace  the  benefit 
attributes.  This  can  be  taken  care  of  to  some  extent  with 
mission  capabilities  analyses.  These  analyses  will  be  most 
useful  in  developing  priorities  for  the  many  icebergs,  however, 
and  not  as  useful  for  prioritizing  the  different-size  tips 
of  these  icebergs.  A  simple  structure  of  benefit  attributes 
like  that  depicted  in  Figure  3-6  would  be  very  useful  to 
the  sponsors  and  cross-sponsor  group.  This  is  just  a  sugges¬ 
tion  that  can  and  should  be  improved  upon  substantially. 

3 . 4  Budget  Decision  Issue  Prioritization 


TO  BE  PUBLISHED 


3 . 5  Advantages  of  the  Cost-Benefit  Prioritization 

The  cost-benefit  procedures  used  in  these  applications 
should,  in  theory,  lead  to  better  resource  allocation  decisions 
if  valid  benefit  and  cost  information  is  used. 
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ARMY  COMBAT  EFFECTIVENESS 


MATERIEL  TRAINING 


Figure  3-6.  Benefit  Attributes 


( 


( 
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3.5.1  Justification  of  POM  recommendations  -  The 
systematic  assessment  process  that  generated  the  benefits 
and  produced  the  cost-benefit  ordering  of  PDIP's  also  pro¬ 
duced  discussions  and  information  that  supported  and  justi¬ 
fied  the  quantifications  of  benefit.  The  sponsors  used  this 
information  to  write  terse  descriptions  of  the  supporting 
rationale  for  the  benefit  numbers  assigned  to  each  PDIP. 

These  descriptions  can  be  used  when  others  ask  for  clarifi¬ 
cation  of  the  benefit  scale.  •■Additional  attributes  of  this 
process  are  its  responsiveness  to  requests  for  "what-if" 
analyses,  and  its  adaptability  to  changes  that  may  occur. 

The  cost-benefit  approach  and  the  structure  it  imposes 
generates  this  responsiveness  and  adaptability  because  the 
theory  dictates  how  changes  are  incorporated  and  what  the 
resultant  rankings  of  prospective  procurements  are.  Questions 
about  what  procurements  must  be  eliminated  in  order  to  fund 
others  can  be  easily  and  effectively  answered. 

3.5.2  Availability  of  interactive  computer  support  - 
An  IBM  5100  mini-computer  is  programmed  to  do  most  of  the 
calculations  and  data  storage,  retrieval,  and  manipulation 
needed  by  the  working  group  responsible  for  preparation  of 
the  POM.  The  software  in  this  computer  is  interactive  in 
the  sense  that  the  officers  responsible  for  POM  preparation 
can  use  it  after  a  very  short  instructional  period  without 
the  assistance  of  a  computer  programmer.  They  can  make 
changes  to  the  data  and  ask  for  new  displays/printouts  at 
their  own  convenience  without  relying  on  others  or  waiting 
in  the  queues  often  associated  with  large  computer  systems. 
Their  turn-around  time  is  on  the  order  of  minutes  or  hours, 
and  they  can  take  the  computer  to  meetings  and  briefings 

with  them.  This  gives  the  officers  a  high  level  of  confidence 
in  the  output  of  the  computer  because  they  are  controlling 
the  inputs  and  the  computer  processing  themselves. 


3.5.3  Identification  of  critical  decision  areas  -  The 
cost-benefit  approach  also  facilitates  the  rapid  identifica¬ 
tion  of  the  real  decision  points;  that  is.,  that  subset  of 
PDIP's  in  the  "gray  area"  of  the  decision-making  process 
quickly  surfaced.  Consequently,  most  of  the  subsequent 
discussion  can  be  focused  on  the  troublesome  subset  rather 
than  spread  evenly  across  all  the  PDIP's. 
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4.0  MISSION  CAPABILITY  ANALYSIS  APPLICATIONS 


"TO  BE  PUBLISHED" 


5 . 0  COMMENTS 


5.1  Deviations  from  the  Cost-Benefit  Prioritization 


As  we  discussed  in  Section  3.2,  there  are  reasons  for 
the  Army  to  deviate  from  the  cost-benefit  priority.  These 
reasons  include: 

o  OSD  Directives , 

o  Must-pay  bills  (these  should  be  scrubbed  thoroughly) , 

o  Program  imbalance, 

o  Manpower  constraints, 

o  Congressional  priorities, 

o  Production  line  considerations, 

o  Prior  commitments  (these  should  be  scrubbed 

thoroughly) , 

o  National  and  regional  economic  implications. 

The  recommended  approach  then  is  to  first  develop  the  cost- 
benefit  prioritization  by  using  Army  effectiveness  as  the 
definition  of  benefit.  Then,  those  decision  units  that  are 
impacted  by  the  above  considerations  should  be  identified  as 
issues  and  moved  up  or  down  the  priority  list  on  an  issue- 
by-issue  basis. 
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5 . 2  Managing  the  Continuum 


Managing  the  continuum  embodies  several  issues,  all 
having  to  do  with  focusing  on  the  life-cycle  nature  of 
programs.  First,  the  decision  makers  must  address  how  well 
the  programs  meet  the  need  in  the  future,  as  well  as  currently, 
and  how  supportable  they  are  in  the  future,  as  well  as 
currently.  This  means  focusing  on  the  life-cycle  costs  and 
benefits,  not  just  the  current  costs  and  benefits. 

This  dual  focus  on  the  present  and  the  future  must 
carry  over  between  the  POM  and  Budget.  Since  the  budget 
process  has  to  focus  narrowly  on  1980  costs,  it  is  easy  to 
downplay  the  importance  of  outyear  costs,  as  well  as  benefits. 
The  POM  process  should  be  organized  well  enough  to  be  usable 
in  the  budget  process  so  that  the  life-cycle  focus  is  not 
lost.  The  POM  to  Budget  handoff  necessitates  a  change  in 
language  and  managers;  this  provides  the  perfect  opportunity 
for  disconnects  and  improves  the  chances  that  the  budget 
process  will  focus  narrowly  on  the  budget  year  rather  than 
the  continuum. 

5 . 3  Decision  Tracking 

Decision  tracking  is  a  mechanism  for  providing  feedback 
to  the  decision  makers  concerning  the  impact  of  the  resources 
they  have  allocated.  Army  decision  makers  are  now  making 
decisions  for  a  budget  in  FY  80.  Concurrently,  the  FY  78 
budget  is  being  spent,  and  the  President  and  Congress  are 
changing  and  approving  the  FY  79  budget.  However,  these 
decision  makers  are  not  receiving  good  feedback  about  the 
impacts  of  the  funds  expended  in  FY  77  and  FY  78.  The 
establishment  of  a  mechanism  to  provide  the  right  amount  and 
detail  of  feedback  to  the  appropriate  decision  makers  is 
necessary  to  improve  the  concept  of  cost  and  mission  benefit 
when  developing  future  POM's. 
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6.0  CONCLUSIONS  AND  RECOMMENDATIONS 

6 . 1  Conclusions 

The  cost-benefit  prioritization  process  based  on  decision- 
analytic  techniques  uses  the  current  staff  organization 
without  requiring  any  adaptations.  In  fact,  the  process  is 
nothing  more  than  a  highly  disciplined  staff  action  using 
the  relevant  expertise  of  each  staff  element. 

This  prioritization  process  has  not  been  developed  and 
tested  within  the  Army.  Plans  have  been  formulated  to  apply 
this  process  during  the  analysis  and  prioritization  of 
budget  issues.  In  addition,  this  process  is  applicable  to 
other  Army  resource  allocation  procedures  and  committees 
(such  as  the  RDAC,  CRRC,  SIPC,  and  BRC) .  Other  decision 
analytic  techniques  could  well  be  applicable  at  other  decision¬ 
making  levels  within  the  Army  and  should  be  investigated. 

The  general  reaction  of  the  action  officers  and  general 
officers  to  the  prioritization  drill  has  been  positive.  In 
fact,  many  would  have  preferred  to  abandon  the  POM  priority 
list  for  the  cost-benefit  priority  list,  and  then  determine 
deviations  as  discussed  in  Section  5.1.  The  advantages  of 
using  the  cost-benefit  procedure  are: 

o  POM  is  more  justifiable  and  defensible  because: 

cost-benefit  approach  is  fiscally  responsible; 

better  rationale  for  the  importance  of  the 
PDIP's  is  provided; 

response  time  for  ''what-if  analyses  is 
short; 
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sensitivity  analysis  can  be  conducted  easily. 

o  responsive  computer  support  for  management  decision 
making  is  assured. 

o  identification  of  the  critical  decision  areas  is 
provided  for: 

attributes  besides  Army  effectiveness  can  be 
factored  in  systematically; 

PDIP's  around  the  decremented,  basic,  and 
enhanced  funding  levels  can  be  scrutinized. 

The  decision  analyst  involved  in  this  process  is  a  facili¬ 
tator  who  provides  a  structure  and  expertise  for  quantifying 
the  judgments  of  the  content  experts.  The  Army  staff  pro¬ 
vides  the  many  levels  of  this  content  expertise,  the  require¬ 
ments  of  which  parallel  the  current  Army  staff  organization 
structure.  This  procedure  provides  a  structure  and  a  disci¬ 
pline  for  the  expertise  of  all  elements  of  the  Army  staff. 

6.2  Recommendations 


The  success  of  the  cost-benefit  prioritization  procedures 
described  in  this  report  indicates  that  these  analytical  tech¬ 
niques  should  be  codified  and  adopted  as  the  Army  prioritization 
system.  Our  recommended  course  of  action  for  accomplishing 
this  is  the  following: 

(1)  The  DCSOPS  should  determine  the  macro  parameters 
involved  in  codifying  the  process. 

(2)  The  Force  Packaging  Methodology  and  Army  Goals  should 
be  used  as  the  initial  framework  into  which  this 
process  is  instituted. 
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(3)  Improvements  to  this  framework  should  be  derived 
from  both  experience  with  the  process  and  the 
results  of  total  mission  capabilities  analysis  as 
described  in  Section  2.2. 
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